Visually enhanced tactile feedback

ABSTRACT

In an approach for visually enhancing tactile metadata, a computer receives an image on a first computing device. The computer selects an object from one or more objects depicted within the received image. The computer determines boundaries of the selected object. The computer assigns an object tag to the selected object within the determined boundaries, wherein the assigned object tag includes one or more keywords and terms describing the selected object. The computer assigns tactile metadata to the selected object within the determined boundaries based on one or more physical properties associated with the assigned object tag. The computer creates a visually enhanced image based on the assigned tactile metadata, wherein the assigned tactile metadata includes one or more physical properties associated with the assigned object tag capable of being represented visually.

BACKGROUND OF THE INVENTION

The present invention relates generally to the field of tactile feedbacktechnology, and more particularly to creating a visual representation oftactile feedback.

Haptic technology, or haptics, is a tactile feedback technology thatrecreates the sense of touch by applying forces, vibrations, or motionsto a user through actuators (e.g., motors responsible for movement)incorporated in a computing device. Haptics manipulate the actuatorusing defined waveforms to produce a range of effects which may beperceived uniquely by an individual touching the computing device.Initially, haptics were only capable of providing strong feedback with alimited range of sensations to an entire device or providing limitedlocalization of haptic feedback to a specific position (e.g., displayinstead of the body of the device) with an expanded effects, such asfrequency range, response time, and intensity. As the technologycontinues to evolve, haptics currently incorporated in computing devicesnow provide the means to deliver both touch-coordinate specificresponses and customizable haptic effects (e.g., virtual keyboardscrolling list) to the user.

When sensing physical interaction between a user and a computing deviceis necessary, haptic computing devices incorporate tactile sensors thatmeasure information arising from a physical interaction with theenvironment. One of the most common implementations of tactile sensorsare touchscreen devices, such as those utilized in mobile devices andcomputing. The touchscreen device allows a user to interact directlywith what is displayed (e.g., images, icons, virtual keyboards,applications, etc.) by touching the screen with a specialized stylusand/or one or more fingers rather than utilizing an intermediate device,such as a computer mouse or a touchpad. The mechanical stimulationprovided by the haptic feedback may then be utilized to assist in thecreation of virtual objects in a computer simulation (e.g., developedmodel representing characteristics, behaviors, and functions of aphysical or abstract system over time). The continued exchanges betweenthe user and computer simulation via the touchscreen may then provideadditional feedback (e.g., changes and updates to images, textresponses, change in displayed information, etc.), which allows forconfirmation of actions taken by a user and for additional interactionsto occur based on received responses.

Digital images created and displayed by a computing device includemetadata. Metadata provides information regarding the data content ofthe actual digital image. For example, digital images may includemetadata that describes how large the picture is, the color depth, theimage resolution, when the image was created, and other relevant data.In addition to the aforementioned metadata, additional metadata (e.g.,GPS coordinates, compression ratios, software, etc.) and object tags(e.g., non-hierarchical keyword or term assigned to a digital imagedescribing an item) may be changed and assigned to the digital image bya user and through image processing software which includesincorporating tactile effects. For example, a user or image processingsoftware may identify objects and the boundaries associated with theobject within a digital image. Once the boundaries of an object aredefined, additional tactile effects may then be added to the metadata(e.g., tactile metadata), enhancing the viewing experience of futureusers.

SUMMARY

Aspects of the present invention disclose a method, computer programproduct, and system for visually enhancing tactile metadata. The methodincludes one or more computer processors receiving an image on a firstcomputing device. The method further includes one or more computerprocessors selecting an object from one or more objects depicted withinthe received image. The method further includes one or more computerprocessors determining boundaries of the selected object. The methodfurther includes one or more computer processors assigning an object tagto the selected object within the determined boundaries, wherein theassigned object tag includes one or more keywords and terms describingthe selected object. The method further includes one or more computerprocessors assigning tactile metadata to the selected object within thedetermined boundaries based on one or more physical propertiesassociated with the assigned object tag. The method further includes oneor more computer processors creating a visually enhanced image based onthe assigned tactile metadata, wherein the assigned tactile metadataincludes one or more physical properties associated with the assignedobject tag capable of being represented visually.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional block diagram illustrating a mobile computingenvironment, in accordance with an embodiment of the present invention;

FIG. 2 is a flowchart depicting operational steps of a tactile imagecapture program on a client device within the mobile computingenvironment of FIG. 1 for assigning additional visual enhancements totactile metadata, in accordance with an embodiment of the presentinvention;

FIG. 3 illustrates operational steps of a tactile image conversionprogram on a server within the mobile computing environment of FIG. 1for creating an executable application with visually enhanced tactilemetadata, in accordance with an embodiment of the present invention;

FIG. 4 illustrates operational steps of a tactile image viewerapplication on a client device within the mobile computing environmentof FIG. 1 for installing an executable application allowing the viewingof an image including visually enhanced tactile metadata, in accordancewith an embodiment of the present invention;

FIG. 5 is a block diagram of components of the proxy server computerexecuting the tactile image conversion program, in accordance with anembodiment of the present invention.

DETAILED DESCRIPTION

Online and mobile commerce has been increasing especially due to theadoption of mobile devices, such as smartphones and tablet computers andthe increasing availability of wireless network communications (e.g.,wireless technology enabling the exchange of data over the Internet). Byutilizing a mobile device, a consumer is able to research, examine,compare, and purchase products at the convenience of the user wheneveran Internet connection is available. However, typically a consumer isonly able to view an image of the product and read the related productdescription and consumer reviews. In some instances when haptic feedbackis incorporated, a consumer may be able to receive limited tactilefeedback through applied forces, vibrations, and motions providing anindication of a characteristic of the product, such as texture, but theperception of temperature and elasticity is limited to an actualphysical interaction between a consumer and the product.

Embodiments of the present invention recognize that the perception oftemperature and elasticity (e.g., the ability of a material to resumeits natural shape after being stretched or compressed) are difficult toemulate as tactile feedback and do not translate effectively from aviewable image over the Internet. Additional embodiments of the presentinvention provide a means to visually enhance an image with tactilefeedback to provide a user with visual cues related to the type oftactile feedback that would be encountered. Additionally, embodiments ofthe present invention recognize the processing capabilities to performand view the enhancements may not be present on all computing devices.Embodiments of the present invention create an installable applicationfor the computing device of a designated recipient after a separatecomputing device processes a received image with enhanced tactilefeedback metadata.

The present invention will now be described in detail with reference tothe Figures. FIG. 1 is a functional block diagram illustrating a mobilecomputing environment, generally designated 100, in accordance with oneembodiment of the present invention. FIG. 1 provides only anillustration of one embodiment and does not imply any limitations withregard to the environments in which different embodiments may beimplemented.

In the depicted embodiment, mobile computing environment 100 includesclient device 110, client device 140, and server 120 interconnected overnetwork 130. Mobile computing environment 100 may include additionalcomputing devices, mobile computing devices, servers, computers, storagedevices, or other devices not shown.

Client device 110 and client device 140 may be an electronic device orcomputing system capable of executing machine readable programinstructions and receiving and sending data. In various embodiments,client device 110 and client device 140 may be a laptop computer, atablet computer, a netbook computer, a personal computer (PC), a desktopcomputer, a personal digital assistant (PDA), a smart phone, or anyprogrammable electronic device capable of communicating with anothercomputing device via network 130. In other embodiments, client device110 and client device 140 may represent a computing system utilizingmultiple computers and components acting collectively to perform a taskwhen accessed through network 130, as is common in data centers and withcloud computing applications. Client device 110 includes user interface112, digital image 114, and tactile image capture program 200. Clientdevice 140 includes user interface 142 and tactile image viewerapplication 400. In one embodiment, client device 110 and client device140 are interchangeable and are capable of performing identicaloperations. In the depicted embodiment however, client device 110 isdesignated as the device capturing digital image 114, and client device140 is designated as receiving an enhanced version of digital image 114for viewing.

User interface 112 is a program that provides an interface between auser of client device 110 and a plurality of applications includingtactile image capture program 200, which resides on client device 110and/or may be accessed over network 130. User interface 142 is a programthat provides an interface between a user of client device 140 and aplurality of applications including tactile image viewer application400, which resides on client device 140 and/or may be accessed overnetwork 130. User interface 112 and user interface 142 are capable ofsending and receiving information between client device 110 and clientdevice 140 and sending and receiving information to tactile imageconversion program 300. A user of client device 110 can utilize userinterface 112 to perform actions related to obtaining digital image 114,enhancing metadata for digital image 114 utilizing tactile image captureprogram 200, and sending digital image 114 to client device 140 or totactile image conversion program 300. User interface 112 may alsodisplay digital image 114 and receive information from tactile imagecapture program 200. A user of client device 140 can utilize userinterface 142 to perform actions related to information received fromtactile image conversion program 300 and to interact and view digitalimage 114 through tactile image viewer application 400.

A user interface, such as user interface 112 and user interface 142,refers to the information (e.g., graphic, text, sound) that a programpresents to a user and the control sequences the user employs to controland interact with the program. A variety of types of user interfacesexist. In one embodiment, user interface 112 and user interface 142 aregraphical user interfaces. A graphical user interface (GUI) is a type ofuser interface that allows users to interact with electronic devices,such as a computer keyboard and mouse, through graphical icons andvisual indicators, such as secondary notation, as opposed to text-basdinterfaces, typed command labels, or text navigation. The actions inGUIs are often performed through direct manipulation of the graphicalelements.

Digital image 114 is a static digital image depiction or recording of avisual perception of a physical item (e.g., photograph) that is capturedby an optical device (e.g., cameras, digital cameras, scanners, computergraphics). A digital image is a numeric representation of atwo-dimensional image (e.g., raster image, bitmap image) containing afinite set of digital values (e.g., pixels) stored as rows and columnswith brightness and color. In one embodiment, digital image 114 may becreated by utilizing a digital camera and photo capture softwareincorporated as part of client device 110. In another embodiment,digital image 114 may be a scanned digital image stored on client device110. In some other embodiment, digital image 114 is received through anapplication (e.g., e-mail client, downloaded webpage image, attachment,etc.) installed on client device 110, and is then stored on clientdevice 110. In the depicted embodiment, digital image 114 resides onclient device 110. In another embodiment, digital image 114 may resideon client device 140, server 120, or on another client device, server,or storage device (not shown) provided digital image 114 is accessibleto tactile image capture program 200.

Server 120 may be any electronic device or computing system capable ofprocessing program instructions and receiving and sending data. In someembodiments, server 120 may be a laptop computer, a tablet computer, anetbook computer, a PC, a desktop computer, a PDA, a smart phone, or anyprogrammable device capable of communication with client device 110 andclient device 140 over network 130. In other embodiments, server 120 mayrepresent a server computing system utilizing multiple computers as aserver system, such as in a cloud computing environment. Server 120includes tactile image conversion program 300 and executable application122.

Executable application 122 may be a file or program, which wheninitiated on a computing device results in the execution of indicatedtasks according to encoded instructions resulting in the installation oftactile image viewer application 400 on a client device (e.g., clientdevice 140). Executable application 122 is created by tactile imageconversion program 300 upon receipt of an enhanced version of digitalimage 114 from tactile image capture program 200. In the depictedembodiment, executable application 122 resides on server 120. In otherembodiments, executable application 122 may reside on another server orclient device provided executable application 122 can be sent to clientdevice 140.

Network 130 may be a local area network (LAN), a wide area network (WAN)such as the Internet, a wireless local area network (WLAN), anycombination thereof, or any combination of connections and protocolsthat will support communications between client device 110, clientdevice 140, server 120, other computing devices, and servers (notshown), in accordance with embodiments of the inventions. Network 130may include wired, wireless, or fiber optic connections.

Tactile image capture program 200 is a software program for assigningadditional metadata to digital image 114 (e.g., for later use by tactileimage conversion program 300). Tactile image capture program 200 assignstactile metadata to assist in the creation of an enhanced version ofdigital image 114, which is capable of providing an animated interactivevisual representation of tactile feedback when digital image 114 islater viewed. Tactile image capture program 200 transmits an enhancedversion of digital image 114 (e.g., digital image 114 with assignedmetadata) to tactile image conversion program 300. In the depictedembodiment, tactile image capture program 200 resides on client device110. In other embodiments, tactile image capture program 200 may resideon other devices, such as client device 140 or server 120, provided thattactile image capture program 200 is accessible to user interface 112and has access to digital image 114 and tactile image conversion program300. Tactile image capture program 200 is described in more detail inFIG. 2.

Tactile image conversion program 300 is a software program capable ofproviding additional enhancements to received digital image 114 andprocessing the tactile metadata assigned within digital image 114 tocreate executable application 122. Tactile image conversion program 300receives an enhanced version of digital image 114 with tactile metadatafrom tactile image capture program 200. After processing, tactile imageconversion program 300 sends an executable application to client device140 for installation. In the depicted embodiment, tactile imageconversion program 300 resides on server 120. In other embodiments,tactile image conversion program 300 may reside on other devices, suchas another client device or server (not shown), provided that tactileimage conversion program 300 is accessible to tactile image captureprogram 200 and has access to client device 140. Tactile imageconversion program 300 is described in more detail in FIG. 3.

Tactile image viewer application 400 is a software program resultingfrom the installation of executable application 122 that is created bytactile image conversion program 300 for digital image 114. Tactileimage viewer application 400 is capable of displaying digital image 114with enhanced visual tactile effects and interpreting actions receivedthrough user interface 142 to display an interactive animated version ofdigital image 114. In the depicted embodiment, tactile image viewerapplication 400 resides on client device 140. In other embodiments,tactile image viewer application 400 may reside on other devices, suchas client device 110, server 120, or on other client devices and serversnot shown, provided that tactile image viewer application 400 isaccessible to user interface 142. Tactile image viewer application 400is described in more detail in FIG. 4.

FIG. 2 is a flowchart depicting operational steps of tactile imagecapture program 200, a program for assigning additional visualenhancements to tactile metadata, in accordance with an embodiment ofthe present invention (e.g., allows tactile metadata to be viewedthrough a visual representation. Tactile image capture program 200 maybe initiated and terminated at the discretion of the user of clientdevice 110 in addition to the depicted embodiment.

In step 202, tactile image capture program 200 receives digital image114. In some embodiments, tactile image capture program 200 receivesdigital image 114 as a result of digital image 114 being created by acamera incorporated within client device 110 (e.g., built-in digitalcamera with image capture software). In another embodiment, tactileimage capture program 200 receives digital image 114 as a stored file,which is selected from the memory of client device 110 (e.g., digitalimage 114 is stored in memory and may be selected for future editing).In some other embodiment, tactile image capture program 200 receivesdigital image 114 as a downloaded file from another program and/orapplication installed on client device 110 or over network 130 (e.g.,from the Internet or server 120). For example, digital image 114 may besent to an e-mail client as an attachment from another user, which maybe saved and/or accessed for viewing and editing. Once digital image 114is received and opened, tactile image capture program 200 displaysdigital image 114 on client device 110.

In decision 204, tactile image capture program 200 determines whethertactile effects are to be added to digital image 114. In one embodiment,tactile image capture program 200 may provide a message inquiringwhether tactile effects are to be added to digital image 114. Tactileimage capture program 200 may provide a message when digital image 114is active (e.g., at the time receipt, opened for viewing, prior tosending, etc.). For example, upon taking a picture resulting in digitalimage 114 (or viewing a previously captured image of digital image 114),tactile image capture program 200 may display a message such as “Addtactile effects to digital image 114?” with “yes” and “no” selections onuser interface 112. Tactile image capture program 200 may then receive aselection via user interface 112 of one of the two selections. Inanother embodiment, tactile image capture program 200 may providesuggestions of tactile effects to add (e.g., edit metadata, add objecttags, etc.) which may or may not be selected via user interface 112. Insome other embodiment, tactile image capture program 200 may receive aselection to send the existing version of digital image 114 to arecipient (e.g., text message attachment, e-mail, etc.) indicatingtactile effects are not to be added.

If tactile image capture program 200 determines tactile effects are tobe added to digital image 114 (decision 204, yes branch), then tactileimage capture program 200 enables tactile effects (step 208).Conversely, tactile image capture program 200 may determine tactileeffects are not to be added to digital image 114 (decision 204, nobranch) and then tactile image capture program 200 may send digitalimage 114 directly to a recipient (step 206).

In step 206, tactile image capture program 200 sends digital image 114directly to a recipient. When digital image 114 is not enhanced withadditional tactile effects within the corresponding metadata, additionalprocessing to enable digital image 114 to be viewed on an alternateclient device, such as client device 140, is not necessary. In oneembodiment, tactile image capture program 200 may receive an indicationto store digital image 114 (e.g., digital image 114 may be stored onclient device 110 and/or an alternate device, such as server 120.) Whentactile image capture program 200 stores digital image 114, tactileeffects may be added at a later time or sent to a recipient. In anotherembodiment, tactile image capture program 200 receives a selection tosend digital image 114 to a recipient through an application (e.g.,e-mail, text messaging, file transfer, etc.). Tactile image captureprogram 200 sends digital image 114 from client device 110 to anotherclient device (e.g., client device 140) without modifications to digitalimage 114. Digital image 114 includes the original metadata providedwhen digital image 114 was initially created which is viewable byanother client device without additional processing.

In step 208, tactile image capture program 200 enables tactile effects.Tactile image capture program 200 displays digital image 114 with imageediting functions (e.g., toolbar with functions to edit metadata, addobject tags, edit digital image 114, etc.). Once the tactile imagecapture program 200 enables tactile effects, tactile image captureprogram 200 is capable of receiving selections from within digital image114. Additionally, tactile image capture program 200 is capable ofreceiving a selection from enabled tactile effects and image editingfunctions. Tactile image capture program 200 does not proceed untilselections are made to edit digital image 114. However, a user of clientdevice 110 may close tactile image capture program 200 at the discretionof the user prior to or after adding tactile effects to digital image114.

In step 210, tactile image capture program 200 receives a selectedobject within digital image 114. In one embodiment, tactile imagecapture program 200 receives a selection of an object within digitalimage 114 through user interactions with user interface 112. Forexample, a user may tap an object (e.g., utilizing a stylus or finger)within digital image 114, thus selecting the object. In another example,an object may be selected utilizing a selection tool, drawing a boxaround an object (e.g., standard size box may be dragged over an objectand/or resized to fit and select the object). In another embodiment,tactile image capture program 200 may utilize image processing byapplying stored shapes to identify objects within digital image 114.After tactile image capture program 200 identifies objects, tactileimage capture program 200 may display identified objects to a user,which the user may then select one or more of the displayed objects. Forexample, digital image 114 may be a group of people. Tactile imagecapture program 200 applies stored object patterns to digital image 114,which identifies the faces of individuals in the group of people.Tactile image capture program 200 would then highlight the faces (e.g.,place a box around the faces) and wait for a selection of an identifiedface to add additional effects. Tactile image capture program 200determines the area associated with the selected object within digitalimage 114 (e.g., the boundaries of the object and pixels comprising theobject are identified and stored).

In step 212, tactile image capture program 200 assigns tactile effectswithin the metadata. As tactile image capture program 200 determines theboundaries and pixels associated with an object (step 210), tactileimage capture program 200 is now capable of assigning object tags andtactile metadata to the identified object. Tactile image capture program200 receives an object tag assignment for the identified object. Tactileimage capture program 200 includes a repository of available object tags(e.g., keywords or terms describing an item that are assigned to a pieceof information) to be selected from for assignment to the identifiedobject. In one embodiment, tactile image capture program 200 assigns anobject tag to an object based on a user selection from the availablelist of object tags. For example, a user may select the object tag afterscrolling though the list of object tags, accept the object tag asprovided through an auto-fill feature in response to typing, and accepta recommended object tag based on the shape of the object. In anotherembodiment, tactile image capture program 200 may automatically assignan object tag from the list of available object tags based upon imageprocessing (e.g., determines the type of object through the appliedshaped utilized to determine objects.). Once tactile image captureprogram 200 assigns the object tag to the object, the following tactilemetadata may be assigned to the object to enhance digital image 114 inany order.

Tactile image capture program 200 provides a list of materials tofurther define the tagged object. In one embodiment, tactile imagecapture program 200 may provide a reduced list of materials based uponthe assigned object tag. Tactile image capture program 200 may thenreceive a user selection from the reduced list and assign the material.For example, an object tag of “pillow” was assigned. Tactile imagecapture program 200 may provide a tailored list including materials of“feather,” “memory foam,” “cotton,” and “buckwheat.” In anotherembodiment tactile image capture program 200 may automatically assign amaterial. For example, an object tag of “tree” is assigned. The onlymaterial in the list of materials associated with “tree” is “wood;”therefore, tactile image capture program 200 assigns “wood” as thematerial for the object. In another embodiment, tactile image captureprogram 200 displays the entire list of materials. Tactile image captureprogram 200 may receive a material selection from a user from theavailable materials and assigns the material to the object (may also beused to change an automatic assignment).

Tactile image capture program 200 may also receive tactile metadata inregards to the object defining the elasticity of an object. Elasticityrefers to the ability of an object or material to resume the originalshape after being stretched or compressed (e.g., softness and memory,with softness being the property of transforming a material due toapplied pressure, and memory being the capacity of the material toresume a previous shape after deformation). For example, when anindividual holds a stress ball and applies pressure, the stress balldeforms, taking on the shape of the space available within the hand ofthe individual. When released, the stress ball resumes the originalshape over time, dependent on the type of material the stress ball ismade of. In one embodiment, tactile image capture program 200 may assigna known level of elasticity to an object based upon the propertiesassociated with the object tag and assigned material. In anotherembodiment, tactile image capture program 200 may receive a specifieddistinct value regarding the elasticity of an object based on the valuesavailable. For example, with a mattress, a range of values may beavailable noting the stiffness of the springs. An individual may prefera firm mattress and thus selects a specific value at the high end of therange. In some other embodiment, tactile image capture program 200 mayassign a range of values to an object.

Tactile image capture program 200 may also receive tactile metadataregarding the perceived temperature of an object. In one embodiment,tactile image capture program 200 may receive a single value noting thetemperature associated with an object. For example, the temperature of achair is dependent upon the temperature of the air in a room (e.g., isnot capable of generating heat or cooling effects). The temperature ofthe chair may then be set at a uniform seventy degrees Fahrenheit. Inanother embodiment, tactile image capture program 200 may receive arange of values specifying a lower to higher temperature scale. Forexample, the flame of a candle varies in temperature with the red outerportion of the flame generally being the coolest and the inner blueportion of the flame being the hottest. Once tactile image captureprogram 200 receives temperature information, tactile image captureprogram 200 assigns the tactile metadata for the object within digitalimage 114.

In step 214, tactile image capture program 200 sends digital image 114with the tactile effects for processing. In response to assigningtactile metadata to objects within digital image 114 (step 212), tactileimage capture program 200 sets a flag within the metadata of digitalimage 114, thus changing the protocol associated with sending digitalimage 114 to a recipient (e.g., client device 140). The additionaltactile metadata incorporated in digital image 114 may not be viewableby client device 140 without additional processing. For example, iftactile image capture program 200 sends digital image 114 directly toclient device 140 without processing, an error may result when clientdevice 140 initiates actions to view digital image 114 as theinformation and/or file format may not be recognized. Tactile imagecapture program 200 receives a selection to send digital image 114 to arecipient (e.g., user of client device 140). As digital image 114includes the updated flag noting a change in protocol, tactile imagecapture program 200 sends digital image 114 to tactile image conversionprogram 300. In addition, tactile image capture program 200 includes theinformation associated with the designated recipient to be utilizedafter processing is performed by tactile image conversion program 300.

FIG. 3 illustrates operational steps of a tactile image conversionprogram 300, a program for creating an executable application withvisually enhanced tactile metadata, in accordance with an embodiment ofthe present invention.

In step 302, tactile image conversion program 300 receives digital image114 with tactile metadata from tactile image capture program 200 overnetwork 130. In addition to digital image 114, tactile image conversionprogram 300 receives recipient information (e.g., e-mail address, cellphone number) to complete the initiated send request of digital image114. Upon receipt of digital image 114 from tactile image captureprogram 200, tactile image conversion program 300 initiates.

In step 304, tactile image conversion program 300 determines whetherobjects within digital image 114 include tactile metadata. Tactile imageconversion program 300 processes the enhanced version of digital image114 and extracts the objects with associated tactile metadata. Tactileimage conversion program 300 creates a table with the information basedon the extracted information (e.g., objects and tactile metadata formaterial, elasticity, and temperature). Tactile image conversion program300 then determines whether objects are included within the table thatdo not include information in one or more of the associated tactilemetadata categories (e.g., tactile metadata for a material, elasticity,and temperature, etc.).

If tactile image conversion program 300 determines identified objectswithin digital image 114 include tactile metadata (decision 304, yesbranch), then tactile image conversion program 300 identifies theboundaries for the visual enhancements. If tactile image conversionprogram 300 determines identified objects within digital image 114 donot include tactile metadata (decision 304, no branch), then tactileimage conversion program 300 determines objects without tactile metadata(step 306).

In step 306, tactile image conversion program 300 identifies objectswithout tactile metadata. Tactile image conversion program 300identifies entries within the table that correspond to objects that donot include tactile metadata (e.g., object may be one or more ofavailable types of tactile metadata).

In step 308, tactile image conversion program 300 determines theprobable material of the object and assigns the tactile metadata. In oneembodiment, tactile image conversion program 300 determines the probablematerial by associating the object tag with the provided list ofmaterials, such as when a single material is associated with the objecttag. In another embodiment, tactile image conversion program 300 maydetermine a probable material by analyzing the resolution of the objectto establish the type of material, such as when a material is notassociated with an object tag. In some other embodiment, tactile imageconversion program 300 may utilize the image resolutions to determine amaterial when more than one material is listed with an object tag. Inyet some other embodiment, tactile image conversion program 300 maydetermine the probable material based on similar and related objecttags. For example, two identified objects are assigned an object tag of“car.” Only one of the two object tags for “car” in the table includestactile metadata for material, elasticity, and temperature. Tactileimage conversion program 300 identifies that the entries within thetable for the two object tags are assigned the same value of “car.”Therefore, tactile image conversion program 300 assigns the missingtactile metadata information for the second instance of the object tagof “car” to the same values in the table associated with the firstobject tag of “car.” Once tactile image conversion program 300determines a probable material for the object, tactile image conversionprogram 300 assigns the tactile metadata to the object within digitalimage 114 and the associated extracted table.

At the completion of step 308, tactile image conversion program 300returns to step 304 to determine whether additional objects withindigital image 114 do not include tactile metadata. Tactile imageconversion program 300 repeats steps 304 through 308 until theidentified objects in digital image 114 include tactile metadata.

In step 310, tactile image conversion program 300 identifies theboundaries of the objects within the table for visual enhancements.Tactile image conversion program 300 utilizes the coordinates of thepixels to identify the boundaries of the object. Tactile imageconversion program 300 may use mathematical equations and algorithmsbased upon the shape and the initial provided boundaries defining theshape of the object from the table to assign tactile metadata to theinterior pixels within the objects of digital image 114. In oneembodiment, tactile image conversion program 300 assigns a single valueto the determined pixels of an identified object (e.g., tactile effectvalues are constant). For example, when a temperature is set to aconstant value, the pixels within the object may be set to a constantvalue. In another embodiment, tactile image conversion program 300 mayperform additional calculations to determine different values based on arange of values (e.g., range of values for temperature and/orelasticity). Tactile image conversion program 300 then assigns thevarying levels to the pixels within the boundaries of the identifiedobject based on starting and end points. For example, a picture offlowing lava would transition in both temperature and elasticity as thelava (e.g., higher temperature, greater elasticity) transforms to rocksubstance (e.g., lower temperature, decreased elasticity).

In step 312, tactile image conversion program 300 creates executableapplication 122 for digital image 114. Tactile image conversion program300 utilizes the original tactile metadata and additional information(e.g., object tags, tactile metadata) stored within digital image 114and creates executable application 122, which may be installed on clientdevice 140 to view the enhanced version of digital image 114. Tactileimage conversion program 300 includes the program instructions necessaryto execute the installation of executable application 122 (e.g., createdtactile image viewer application 400) and the program instructions fortactile image viewer application 400. Tactile image conversion program300 displays the initial viewable image (e.g., background) to theenhanced version of digital image 114. Tactile image conversion program300 stores the identified objects and tactile metadata assignmentswithin executable application 122. Tactile image conversion program 300,through the created code for executable application 122, enablesenhanced visual effects to accompany the tactile metadata included inthe enhanced version of digital image 114.

In step 314, tactile image conversion program 300 sends executableapplication 122 to the recipient. Tactile image conversion program 300utilizes the information received in regards to the recipient fromtactile image capture program 200 (step 302). Tactile image conversionprogram 300 then completes the initial send request (e.g., e-mail, textmessage, file transfer) and sends executable application 122 to clientdevice 140.

FIG. 4 illustrates operational steps of a tactile image viewerapplication 400, a program for installing an executable application,allowing the viewing of an image including visually enhanced tactilemetadata, in accordance with an embodiment of the present invention.

Initially client device 140 receives executable application 122 fromtactile image conversion program 300 (step 314). Upon receipt ofexecutable application 122, a user of client device 140 though userinterface 142 selects and allows the installation of executableapplication 122. At the completion of the installation of executableapplication 122, tactile image viewer application 400 is installed andopened on client device 140. Tactile image viewer application 400initiates with the enhanced version of digital image 114 set as thebackground (e.g., initially shown as an image without additional visualenhancement effects visible).

In step 402, tactile image viewer application 400 determines whetherdigital image 114 is selected. Tactile image viewer application 400determines whether a user of client device 140 initiates a physicalinteraction with digital image 114 though user interface 142. Forexample, when utilizing a touchscreen device with a finger or stylus,the user is capable of “touching” the displayed visual image. Thetactile sensors and associated software within client device 140recognize the physical interaction between the user of client device 140and digital image 114 as a selection. Tactile image viewer application400 receives the information conveyed by the tactile sensors anddetermines digital image 114 is selected. Conversely, the tactilesensors may not register a physical interaction between the user ofclient device 140 via user interface 142 and digital image 114. Tactileimage viewer application 400, therefore, does not receive informationfrom the tactile sensors and determines digital image 114 is notselected.

If tactile image viewer application 400 determines digital image 114 isselected, (decision 402, yes branch), then tactile image viewerapplication 400 determines the location of the selection (step 404). Iftactile image viewer application 400 determines digital image 114 is notselected (decision 402, no branch), then tactile image viewerapplication 400 determines whether a selection has been made to closetactile image viewer application 400 (decision 410).

In step 404, tactile image viewer application 400 determines thelocation of the selection. Tactile image viewer application 400retrieves the coordinates of the interaction with user interface 142(e.g., the coordinates for point of the physical interaction with thestylus and the touchscreen). Tactile image viewer application 400applies the retrieved coordinates to the stored information regardingdigital image 114. In an example embodiment, the retrieved coordinatesfrom user interface 142 directly correspond to pixel coordinates withindigital image 114, and tactile image viewer application 400 is,therefore, able to determine the location of the selection withindigital image 114.

In decision 406, tactile image viewer application 400 determines whetherthe selection includes tactile metadata. In one embodiment, tactileimage viewer application 400 utilizes the coordinates retrieved from thephysical interaction and searches a table of object tags and tactilemetadata for matching coordinates (e.g., the table created in step 304of tactile image conversion program 300). In another embodiment, tactileimage viewer application 400 may compare the coordinates retrieved fromthe physical interaction with the layout file (e.g., defines the visualstructure) associated with the enhanced version of digital image 114.Tactile image viewer application 400 may determine a complete and/orpartial match between the retrieved coordinates and the coordinateswithin the table and determine tactile metadata corresponding to theselection (e.g., touch coordinated may be included within a larger setof coordinates, coordinates may be on the edge of an object).Alternatively, tactile image viewer application 400 may determine thatnone of the retrieved coordinates are found in the table and determinestactile metadata is not included for the selection. For example, digitalimage 114 includes a single-object tag identified as a rubber ball,which includes tactile metadata. The area surrounding the rubber balldoes not have any tactile metadata associated with the coordinates(e.g., rubber ball is surrounded by air). When the physical interactionis identified as touching the rubber ball, tactile image viewerapplication 400 determines the selection includes tactile metadata.Alternatively, when the physical interaction is associated withcoordinates outside of the coordinates for the rubber ball, tactileimage viewer application program 400 determines the selection does notinclude tactile metadata.

If tactile image viewer application 400 determines the selectionincludes tactile metadata (decision 406, yes branch), then tactile imageviewer application 400 displays the tactile metadata with animationeffects. If tactile image viewer application 400 determines theselection does not include tactile effects (decision 406, no branch),then tactile image viewer application 400 determines whether a selectionhas been made to close tactile image viewer application 400 (decision410).

In step 408, tactile image viewer application 400 displays the tactilemetadata with animation. When tactile image viewer application 400determines retrieved coordinates from the physical interaction matchcoordinates within the stored table, tactile image viewer application400 displays a visual enhancement of the tactile metadata from the tablethat corresponds to the matching coordinates. At the point of contact(e.g., physical interaction), tactile image viewer application 400 maydisplay a shape around the point of contact (e.g., transparent haloshape, circle, highlight, etc.). Tactile image viewer application 400determines the size of the shape based on the calculated areaconstituting the physical interaction between the user of user interface142 and the object in digital image 114 (e.g., the area of the objectmay be larger than the area touched but only the touched area ishighlighted). Tactile image viewer application 400 may also display theshape with a calculated shadow gradient (e.g., additional shading aroundthe shape similar to a perceived shadow). Tactile image viewerapplication 400 utilizes the coordinates associated with the initialpoint of contact to begin the enhanced visualization of the tactileeffects. In one embodiment, the shape may remain at a fixed point withindigital image 114. In another embodiment, tactile image viewerapplication 400 may identify motion from the initial point of contact inany direction through user interface 142. When motion is detected,tactile image viewer application 400 follows the traced trajectoryprovided by the motion received through user interface 142 (e.g.,continuous movement from one point to another). Tactile image viewerapplication 400 then incorporates the tactile metadata with enhancedvisual effects starting at the point of contact based on the type oftactile metadata and the corresponding values associated with theidentified object.

For tactile metadata associated with temperature, tactile image viewerapplication 400 may utilize an animation that changes the color of theshape surrounding the point of contact (e.g., fingertip) utilizing acolor coding convention. For example, the color red is typicallyassociated with hot temperatures, and the color blue is typicallyassociated with cold temperatures. The remaining colors of the spectrumbetween red and blue decrease in perceived temperature from hottest tocoldest. Tactile image viewer application 400 may vary the intensity ofthe color of the shape displayed depending upon the value of thetemperature assigned in the tactile metadata to the point of contact.For example, a dark bright blue would indicate a very cold temperaturewhereas a light blue may only indicate cool temperatures. In anotherembodiment, tactile image viewer application 400, in addition to thecolor, may display a message (e.g., text, “!,” fire symbol, etc.)indicating the temperature is above or below what may be safely handled.For example, a picture of liquid nitrogen would show a dark bright bluebut actual contact with liquid nitrogen could result in freezing theflesh of an individual; therefore, tactile image viewer application 400can display a warning indicating the extreme temperature. Tactile imageviewer application 400 may also vary the displayed temperature whenfollowing a trajectory across an image based on a range of values set inthe tactile metadata. For example, a thermal image of the human body maybe incorporated into the tactile metadata of an image of a person. Thecore of the body near the heart is depicted as red (e.g., hot) which isthe initial point of contact. As a finger traces a trajectory across theimage between the heart and fingertips, the color of the shape followingthe path of the trajectory eventually changes to a yellow at theshoulder, followed by green through the upper arm, and finallytransitions to a blue color when the hand and fingers are reached.

For tactile metadata associated with elasticity (e.g., softness andmemory), tactile image viewer application 400 may incorporate animationeffects into digital image 114 based upon the point of contact. At thepoint of contact, based upon the level of elasticity assigned to theobject, tactile image viewer application 400 alters the digital image todeform to the set level of elasticity (e.g., softer objects such asrubber would be perceived to deform more than a hard object, such aswood, which may not deform in a perceivable manner). For example, at thepoint of contact, tactile image viewer application 400 alters digitalimage 114 to provide the visual perception of a stylus sinking into theimage. Tactile image viewer application 400 may also vary the speed atwhich digital image 114 resumes its shape based upon the level ofelasticity assigned in the tactile metadata. For example, a rubber ballmay resume the original shape almost immediately whereas a stress ballmay resume the original shape over a longer period of time due to thedifferences in elasticity. Tactile image viewer application 400 mayapply additional animation techniques when a trajectory is traced acrossuser interface 142. Depending on the elasticity of the object, tactileimage viewer application 400 modifies digital image 114 based on thetrajectory and the tactile metadata to create animation effect (e.g.,appearance of movement within the viewed image). For example, the objectin digital image 114 is a memory foam pillow. At the initial point ofcontact, a finger is perceived as sinking into the pillow creating adeep depression. As the finger is moved across the pillow, the initialfinger depression remains, and the depression is viewed as moving fromthe initial point of contact across the pillow following the trajectory.When viewing the initial point of contact over time, the material wouldslowly fill back in and resume the initial shape before the initialpoint of contact was made.

In decision 410 tactile image viewer application 400 determines whethera selection has been made to close tactile image viewer application 400.Tactile image viewer application 400 may receive a selection to closetactile image viewer application 400 (e.g., selection of a “x,” select“exit” from a drop down menu, select “close application”). If tactileimage viewer application 400 receives a selection to close (decision410, yes branch), then tactile image viewer application 400 completes.Once tactile image viewer application 400 is completed, a user throughuser interface 142 may select to uninstall tactile image viewerapplication 400. If tactile image viewer application 400 determines aselection was not made to close (decision 410, no branch), then tactileimage viewer application 400 determines whether digital image 114 isselected (step 402). Tactile image viewer application 400 continues todisplay enhanced visual effects for tactile metadata within digitalimage 114 until tactile image viewer application 400 is closed.

FIG. 5 depicts a block diagram of components of mobile computingenvironment 500, in accordance with an illustrative embodiment of thepresent invention. It should be appreciated that FIG. 5 provides only anillustration of one implementation and does not imply any limitationswith regard to the environments in which different embodiments may beimplemented. Many modifications to the depicted environment may be made.

Mobile computing environment includes communications fabric 502, whichprovides communications between computer processor(s) 504, memory 506,persistent storage 508, communications unit 510, and input/output (I/O)interface(s) 512. Communications fabric 502 can be implemented with anyarchitecture designed for passing data and/or control informationbetween processors (such as microprocessors, communications and networkprocessors, etc.), system memory, peripheral devices, and any otherhardware components within a system. For example, communications fabric502 can be implemented with one or more buses.

Memory 506 and persistent storage 508 are computer readable storagemedia. In this embodiment, memory 506 includes random access memory(RAM) 514 and cache memory 516. In general, memory 506 can include anysuitable volatile or non-volatile computer readable storage media.

User interface 112, digital image 114, tactile image capture program200, executable application 122, tactile image conversion program 300,user interface 142, and tactile image viewer application 400 are storedin persistent storage 508 for execution and/or access by one or more ofthe respective computer processors 504 via one or more memories ofmemory 506. In this embodiment, persistent storage 508 includes amagnetic hard disk drive. Alternatively, or in addition to a magnetichard disk drive, persistent storage 508 can include a solid state harddrive, a semiconductor storage device, read-only memory (ROM), erasableprogrammable read-only memory (EPROM), flash memory, or any othercomputer readable storage media that is capable of storing programinstructions or digital information.

The media used by persistent storage 508 may also be removable. Forexample, a removable hard drive may be used for persistent storage 508.Other examples include optical and magnetic disks, thumb drives, andsmart cards that are inserted into a drive for transfer onto anothercomputer readable storage medium that is also part of persistent storage508.

Communications unit 510, in these examples, provides for communicationswith other data processing systems or devices, including resources ofenterprise grid and client devices. In these examples, communicationsunit 510 includes one or more network interface cards. Communicationsunit 510 may provide communications through the use of either or bothphysical and wireless communications links. User interface 112, digitalimage 114, tactile image capture program 200, executable application122, tactile image conversion program 300, user interface 142, andtactile image viewer application 400 may be downloaded to persistentstorage 508 through communications unit 510.

I/O interface(s) 512 allows for input and output of data with otherdevices that may be connected to mobile computing environment. Forexample, I/O interface 512 may provide a connection to external devices518 such as a keyboard, keypad, a touch screen, and/or some othersuitable input device. External devices 518 can also include portablecomputer readable storage media such as, for example, thumb drives,portable optical or magnetic disks, and memory cards. Software and dataused to practice embodiments of the present invention, e.g., userinterface 112, digital image 114, tactile image capture program 200,executable application 122, tactile image conversion program 300, userinterface 142, and tactile image viewer application 400 can be stored onsuch portable computer readable storage media and can be loaded ontopersistent storage 508 via I/O interface(s) 512. I/O interface(s) 512also connect to a display 520.

Display 520 provides a mechanism to display data to a user and may be,for example, a computer monitor.

The programs described herein are identified based upon the applicationfor which they are implemented in a specific embodiment of theinvention. However, it should be appreciated that any particular programnomenclature herein is used merely for convenience, and thus theinvention should not be limited to use solely in any specificapplication identified and/or implied by such nomenclature.

The present invention may be a system, a method, and/or a computerprogram product. The computer program product may include a computerreadable storage medium (or media) having computer readable programinstructions thereon for causing a processor to carry out aspects of thepresent invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the invention.The terminology used herein was chosen to best explain the principles ofthe embodiment, the practical application or technical improvement overtechnologies found in the marketplace, or to enable others of ordinaryskill in the art to understand the embodiments disclosed herein.

What is claimed is:
 1. A method for visually enhancing tactile metadata,the method comprising: receiving, by one or more computer processors, animage on a first computing device; selecting, by one or more computerprocessors, an object from one or more objects depicted within thereceived image; determining, by one or more computer processors,boundaries of the selected object; assigning, by one or more computerprocessors, an object tag to the selected object within the determinedboundaries, wherein the assigned object tag includes one or morekeywords and terms describing the selected object; assigning, by one ormore computer processors, tactile metadata to the selected object withinthe determined boundaries based on one or more physical propertiesassociated with the assigned object tag; and creating, by one or morecomputer processors, a visually enhanced image based on the assignedtactile metadata, wherein the assigned tactile metadata includes one ormore physical properties associated with the assigned object tag capableof being represented visually.
 2. The method of claim 1, whereindetermining the boundaries of the selected object further comprises oneor more of the following: receiving, by one or more computer processors,coordinates identifying the boundaries of the selected object; andutilizing, by one or more computer processors, image processingtechniques to determine the boundaries of the selected object.
 3. Themethod of claim 1, wherein assigning tactile metadata to the selectedobject within the determined boundaries based on one or more physicalproperties associated with the assigned object tag further comprises:receiving, by one or more computer processors, a selection of one ormore physical properties associated with the assigned object tag,wherein the received selection of one or more physical propertiesincludes one or more of the following: a type of material, anelasticity, and a temperature; and assigning, by one or more computerprocessors, the received selection of one or more physical propertiesassociated with the assigned object tag to the selected object withinthe determined boundaries.
 4. The method of claim 1, further comprising:creating, by one or more computer processors, an executable applicationbased on the created visually enhanced image, wherein the createdexecutable application includes an image viewing application capable ofdisplaying tactile metadata in response to user interaction with thecreated visually enhanced image.
 5. The method of claim 4 furthercomprising: installing, by one or more computer processors, the createdexecutable application on a second computing device; displaying, by oneor more computer processors, the created visually enhanced image on thesecond computing device through the installed executable application;determining, by one or more computer processors, whether a selection ismade within the created visually enhanced image; responsive todetermining the selection is made within the created visually enhancedimage, determining, by one or more computer processors, a first locationassociated with the selection; determining, by one or more computerprocessors, whether the determined first location of the selectionincludes tactile metadata; and responsive to determining the firstlocation of the selection includes the tactile metadata, displaying, byone or more computer processors, a shape around the determined firstlocation based on one or more visual enhancements associated with thetactile metadata associated with the determined first location.
 6. Themethod of claim 5, wherein displaying the shape around the determinedfirst location based on one or more visual enhancements comprises one ormore of the following: displaying, by one or more computer processors, atemperature associated with the determined first location as one or morecolors based on one or more temperature values included in the tactilemetadata associated with the first location; and displaying, by one ormore computer processors, an elasticity associated with the determinedfirst location as a deformation and resumption of the enhanced imagebased on the one or more elasticity values included in the tactilemetadata associated with the determined first location.
 7. The method ofclaim 5 further comprising: determining, by one or more computerprocessors, whether the determined first location made within thecreated visually enhanced image includes a continuous movement from thedetermined first location to a second location; responsive todetermining the determined first location made within the createdvisually enhanced image includes a continuous movement from thedetermined first location to the second location, determining, by one ormore computer processors, a trajectory corresponding to the continuousmovement; and displaying, by one or more computer processors, ananimation in the determined trajectory based on tactile metadata betweenthe determined first location and the second location.